Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "Add support for arrays in hashaggregate [databricks] (#6066)" #6679

Merged
merged 1 commit into from
Oct 4, 2022

Conversation

razajafri
Copy link
Collaborator

This reverts commit 122e107.

Cudf doesn't give us control over what aggregate it will use. This change was for Hashaggregates but the First operator could also use a Hashaggregate and then try to sort the output but fails since sorting isn't yet supported by cudf for arrays

Signed-off-by: Raza Jafri [email protected]

@razajafri razajafri requested a review from revans2 October 3, 2022 19:49
Copy link
Collaborator

@revans2 revans2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The revert looks clean

@revans2
Copy link
Collaborator

revans2 commented Oct 3, 2022

build

@sameerz sameerz added the bug Something isn't working label Oct 3, 2022
@sameerz sameerz added this to the Sep 26 - Oct 7 milestone Oct 3, 2022
@razajafri razajafri merged commit c05ac2d into NVIDIA:branch-22.10 Oct 4, 2022
@razajafri razajafri deleted the revert_hash_agg_arrays branch October 4, 2022 17:19
abellina pushed a commit to abellina/spark-rapids that referenced this pull request Oct 5, 2022
…6066)" (NVIDIA#6679)

This reverts commit 122e107.

Signed-off-by: Raza Jafri <[email protected]>

Signed-off-by: Raza Jafri <[email protected]>
Co-authored-by: Raza Jafri <[email protected]>
razajafri added a commit to razajafri/spark-rapids that referenced this pull request Jan 6, 2023
razajafri added a commit that referenced this pull request Jul 13, 2023
* Revert "Revert "Add support for arrays in hashaggregate [databricks] (#6066)" (#6679)"

This reverts commit c05ac2d and adds tests 

* Add test for aggregation on array

* updated docs

---------

Signed-off-by: Raza Jafri <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants